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Scientific  Work  Done  During  The  Reporting  Period 


(a)  An  overview  of  the  concepts  developed  during  the 
first  year  of  this  project,  which  we  name  now  for 
short  "Photo-Interpretation  Expert"  PHIX  is 
attached  to  this  report.  It  contains  also  a 
listing  of  functions  of  the  image  processing  system 
DIBAG. 

(b)  The  aerial  image  material  is  partly  digitized  and 
is  available  on  digital  tapes.  Preprocessing  which 
compensates  for  errors  due  to  the  scanning  process 
was  carried  out. 

(c)  The  test  of  the  interface  to  DESBOD,  the  map  data 
base  and  geoinformation  system,  proved  successful 
so  that  realistic  map  data  will  now  be  entered. 

(d)  Experiments  for  feature  extraction  for  monochrome 
images,  including  texture  and  neighbourhood-related 
properties,  are  carried  out  to  select  optimal  data 
for  object  recognition. 

(e)  The  image-to-image  registration  procedure  was 
extended  by  a  module  where  ancillary  navigation 
data  may  be  used  to  generate  the  anchor  point  grid 
for  resampling.  Geometries  may  be  those  of  metric 
cameras  (central  perspective)  or  spectral  scalling 
systems.  The  module  includes  access  to  a  digital 
terrain  model  so  that  also  images  of  areas  with 
more  complicated  topography  may  be  considered. 


2 .  Research  plans 


During  the  third  quarter  in  the  project's  schedule  the 
following  tasks  will  be  treated: 

(a)  Test  of  recognition  procedures  and  segmentation 
with  map  data. 

(b)  Investigations  of  possibilities  to  describe  general 
knowledge  in  the  relational  data  base  level  of  the 
geoinf ormation  system. 

(c)  development  of  raster-to-vector-conversion 

algorithms  for  the  symbolic  description  of  located 
objects . 
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Attachment  to  Fourth  Progress  Report 
Contract  Number  DAJA  45-83-C— 0022 

Correcting  a  Digital  Map  Data  Base  by  Scene  Analysis: 

Concepts  and  Methods 

H.Ranzinger  F.Leberl 

Graz  Research  Center 

Introduction 

The  field  of  applications  of  computer  sciences  i3 
rapidly  increasing.  At  the  beginning,  computers  were  used 
in  the  original  sense  of  the  word,  namely  to  calculate 
numerical  problems.  Soon  the  question  arose  whether  these 
machines  were  capable  of  performing  "intelligent"  tasks 
which  go  far  beyond  purely  mechanical  procedures.  This  lead 
to  the  emergence  of  a  new  branch  in  science:  Artificial 
Intelligence  (AI). 

The  goal  of  artificial  intelligence  is  to  propose  and 
develop  methods  which  make  use  of  a  computer's  capabilities 
to  process  information  similar  to  biological  organisms. 
Here,  one  of  the  information  sources  is  visual  perception, 
with  which  computer  vision  in  concerned.  Computer  vision 
is,  after  Ballard  and  Brown  (1982),  the  "construction  of 
explicit,  meaningful  descriptions  of  physical  objects  from 
images" . 


Modern  imaging  systems  acquire  image-like 

representations  of  the  world  already  in  digital  form.  Much 
effort  has  been  put  into  information  extraction  from  these 
data  alone  and  has  yielded  a  solid  basis  of  digital  image 
processing  methods.  However,  human  perception  of  the  world 
involves  knowledge,  which  is  mostly  acquired  by  learning  and 
subsequent  deduction.  The  issue  in  artificial  intelligence 
is  therefore  to  make  knowledge  in  some  form  also  accessible 
to  automata. 

Expert  Systems  And  Knowledge 

The  incorporation  of  knowledge  in  a  program  leads  to 
so-called  expert  systems.  Nau  (1983)  gives  an  overview  of 
the  concepts  involved.  The  model  for  problem-solving  is 
stated  explicitly  in  a  knowledge-base.  This  may  be  termed 
as  propositional  or  descriptive  representation  as  opposed  to 
procedural  knowledge  where  the  program  code  itself  contains 
the  strategies  to  be  taken. 

McCalla  and  Cerone  0983)  name  the  following  approaches 
to  knowledge  representation 

-  semantic  networks 

-  first-order-logic 

-  frames 

-  production  systems 

The  knowledge-base  is  manipulated  by  a  separate  control 
strategy.  Of  course,  on  a  high  level,  the  control  structure 
itself,  as  it  is  a  program,  incorporates  again  procedural 
knowledge,  namely  how  to  handle  the  knowledge-base,  and  thus 
limits  the  set  of  actions  which  can  be  made.  Thus,  today’s 
expert  systems  are  constructed  with  respect  to  particular 
applications,  at  present  predominantly  in  medical  consulting 
and  in  natural  language  understanding. 


Specification  Of  The  Problem  Of  This  Study 


In  this  study,  we  a-re-  concerned  with  one  special  aspect 
of  the 'computer  vision:  How  can  knowledge  in  the  form  of  a 
digital  map  serve  in  automatic  image  interpretation,  and,  on 
the  other  hand,  how  can  interpretation  results  be  used  to 
change  or  update  the  map?  In  a  wider  sense,  ^map"’  may  mean 
any  graphic  representation  of  a  scene  that  is  imaged.  Here, 
in  particular,  vre  deal.ftwith  maps  in  the  cartographic  sense, 
and  with  images  from  airborne  photographic  systems.  One  of 
the  obvious  applications  is  the  correction  or  densif ication 
of  a  map  data  base  using  time  series  of  aerial  surveying 
imagery. 

The  aim  of  this  study  therefore  is  the  design  of  a 
strategy  to  evaluate  the  usefulness  of  image-map 
correspondence  to  aid  the  interpretation  of  digital  aerial 
photography.  This  is  the  first  step  to  be  taken  towards  a 
photo-interpretation  expert  system,  which  we  shall 


henceforth  name  PHIX. 


Aerial  photography  is  one  source  for  the  update  of 
cartography.  It  is  acquired  on  a  regular  basis,  however, 
the  updating  for  many  map  series  is,  as  a  rule,  several 
years.  Support  in  the  interpretation  of  the  imagery  can  be 
given  by  focussing  on  changes  rather  than  on  invariant 
information.  Thus  the  attention  of  the  human  interpreter 
can  be  directed  to  relevant  locations  in  an  image  and,  in  a 
next  step,  supplying  hypotheses  about  the  nature  of  the 
inconsistencies  between  map  and  image.  He  then  can 
interactively  work  on  the  data  indicated  and  enter  his 
interpretation  in  a  suitable  form. 


A  Review  Of  Literature 

Several  efforts  have  been  described  in  the  literature 
to  use  a  map  data  base  to  analyse  aerial  images. 

At  the  Stanford  Research  Institute,  Barrow  et  al. 
(1977),  Tenenbaum  et  al.  (1978)  or  Fischler  et  al.  (1979) 
used  map  data  to  guide  feature  detection.  Roads  or 
coastlines  were  identified  by  predicting  their  locations  and 
thus  restricting  the  search  in  the  image  matrix  to  small 
areas  where  elaborate  pattern  recognition  methods  could  be 
applied. 

Lantz  et  al.  (1978)  describe  an  approach  taken  at  the 
University  of  Rochester.  A  semantic  network  is  used  to 
represent  declarative  and  relational  knowledge  of  the  image 
contents.  The  nodes  in  the  network  describe  which 
procedures  are  to  be  performed  during  interpretation. 

At  Carnegie-Mellon  University,  McKeown  (1982)  and 
McKeown  and  Denlinger  (1982)  report  on  a  semi-automatic 
image  understanding  system  which  relies  on  a  pictorial 
database,  a  map  data  base  and  a  rule  base,  where  the  rules 
have  general  knowledge  about  objects  of  the  real  world 
rather  than  present  particular  facts  about  specific  objects. 
A  first  application  -  the  segmentation  of  airport  scenes  - 
shows  the  feasibility  of  this  approach,  though  the  very 
general  concept  pays  -  at  the  current  state  of  available 
computing  power  -  a  heavy  computing  time  penalty. 

Havens  and  Mackworth  (1983)  from  the  University  of 
British  Columbia  describe  the  Mapsee2-system  which  uses 
schema  models  in  a  network.  Each  model  represents  a  class 
of  objects,  providing  a  description  of  the  generic 
properties  of  every  member  of  the  class  and  specifying 
possible  relationships  of  the  class  with  other  schemata  in 
the  network.  With  this  knowledge,  a  structural  description 
of  the  map  is  provided  which  guides  the  segmentation  process 
on  an  aerial  image. 


German 


The  German  Research  Institute  for  Information 
Processing  and  Pattern  Recognition  (FIM)  exhibits  activities 
reported  by  Sties  et  al.  (1977)  or  Kestner  (1980). 


Previous  Own  Work 

The  project  is  based  on  previous  work  performed  under 
ERO  Contracts  and  ongoing  efforts  in  the  development  of 
geoinformation  systems.  Kropatsch  and  Leberl  (1981) 
developed  a  first  concept  of  a  relational  digital  map  data 
base  md  showed  its  applicability  in  map-guided  control  data 
acquisition  for  digital  satellite  image  rectification. 
Leberl  and  Ranzinger  (1982)  extended  the  idea  of 
map-image-correspondence  to  aerial  digital  photography.  In 
both  approaches,  recognition  procedures  were  implemented  to 
identify  objects  in  the  imagery  with  the  help  of  templates 
taken  from  the  map  data  base.  The  basic  image  processing 
algorithms  were  implemented  on  a  dedicated  device  (digital 
video  processor).  A  comprehensive  set  of  primitive  image 
operations  was  defined  which  can  be,  by  means  of  an 
interpreting  program,  combined  to  perform  more  complex 
procedures  (Ranzinger,  1983).  The  idea  of  the  first  map 
data  base  is  currently  being  extended  to  develop  a 
geoinformation  system  (Kainz  and  Ranzinger,  1983). 


Layers  Of  A  Computer  Vision  System 

Problem’  solving  in  artificial  intelligence  involves  a 
multiple-layer  structure  from  the  top,  where  a  problem  is 
stated,  to  the  bottom,  where  circuitry  in  the  computer 
carries  out  a  sequence  of  primitive  operations  fixed  by  the 
processor(s)  incorporated.  Figure  1  gives  an  idea  of  this 
layer  structure,  where  upper  layers  control  lower  layers  and 
lower  layers  serve  as  tools  for  operations  intended  by  upper 
layers.  This  schematic  representation  is,  of  course,  not 
complete,  but  can  be  detailed  at  various  levels  of 


complexity 


Basically,  top-down  concepts  or  bot tom-up-concepts  can 
be  constructed.  However,  top  and  bottom  are  ill-defined 
entities.  At  each  complexity  level  it  may  be  valid  to 
assume  all  lower  layers  to  be  "black  boxes"  with  an 
interface  only  existing  to  the  layer  immediately  below. 

In  the  problem  under  consideration,  we  define  the 
layers  "scene  analysis"  and  "map  data  manipulation"  as  the 
bottom  and  eventually  will  work  upwards  keeping  in  mind  that 
an  expert  system  in  computer  vision  is  the  fir  goal.  Thus 
we  have  to  verify  that  we  can  make  use  of  too  provided  by 
previous  investigations. 

Tools  In  Image  Processing 

The  image  processing  system  currently  in  use  is  DIBAG, 
supporting  research  rather  than  being  a  production  tool.  It 
incorporates  actually  two  more  or  less  equivalent  subsets. 
One  subset  is  designed  to  work  on  general-purpose  hardware 
and  therefore  is  basically  portable  from  one  computer 
architecture  to  another  one.  The  second  subset  makes  use  of 
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an  interactive  image  processing  workstation  and  is  thus 
hardware-dependent.  However,  an  image  processing  language 
has  been  defined  which  allows  problem-oriented  algorithm 
formulation.  Details  on  the  functions  of  each  of  DIBAG's 
components  are  given  in  the  appendix. 

Special  applications  are  implemented  at  first  outside 
the  system  itself,  but  using  the  conventions  regarding  data 
handling.  A  subroutine  library  is  available  which 
incorporates  the  basic  functions  for  image  access  and  user 
interface.  Generally  applicable  algorithms  are  finally 
taken  over  and  become  standard. 

In  this  study,  recognition  procedures  are  of  special 
interest.  The  original  stock  of  histogram  analysis, 
relaxation  and  correlation  has  been  extended  by  a  line 
follower  based  on  gradient  magnitude,  simualtaneous  region 
growing  under  restrictions  and  statistical  feature-space 
classification.  Sequences  of  procedures  are  bound  together 
to  yield  new  functions  by  writing  "macro"-operations  in  the 
control  language  of  the  computer  system. 

Tools  In  Map  Data  Processing 

Based  on  the  experiences  gained  from  a  previously  used 
map  data  base  (Leberl  and  Kropatsch,  1980)  the 
geoinformation  system  DESBOD  is  currently  under  development. 

The  system  comprises  three  principal  parts:  A  data 
compilation  system  to  digitize  spatial  data  and  to  assign 
attributes,  a  map  data  base  system  for  management  and 
retrieval,  and  a  data  analysis  and  output  system.  It  is 
primarily  intended  to  be  use  for  environment  -  related 
planning  and  monitoring  and  for  geoscientif ic  research. 


The  data  structures  involved  are 

-  graphic  elements  and 

-  thematic  elements. 

Graphic  elements  are  points,  lines  and  regions  which 
are  consist  of  the  graphic  primitives  "edge"  and  "node". 
The  graphic  elements  are  on  the  one  hand  coordinate-related 
to  represent  their  spatial  locations  and  on  the  other  hand 
related  to  one  another  by  their  topologic  properties  such  as 
adjacency  or  inclusion. 

Thematic  elements  are  assigned  to  the  graphic  elements 
thus  giving  further  descriptions  of  properties  of  the 
real-world-objects  represented  in  the  data  base.  Again, 
relations  exist  between  thematic  and  graphic  elements  as 
well  as  among  thematic  elements  themselves. 

For  flexible  and  quick  retrieval,  most  of  the  relations 
are  stored  explicitly  so  that  various  data  access  paths  can 
be  selected.  Through  this  construction,  it  will  be  possible 
to  extend  the  system  to  a  general  knowledge-base  by  adding 
an  additional  layer  which  describes,  on  an  abstract  level, 
interrelations  and  inferences  of  thematic  elements  in  the 
sense  of  a  world-model.  However,  this  ambitious  extension 
will  involve  further  research  beyond  the  scope  of  this 
study . 

The  data  analysis  system  as  well  as  the  cartographic 
output  system  are,  at  present,  of  no  concern  for  this  work, 
and  will  therefore  not  be  described  here. 

Connections  Between  Image  Processing  And  Map  Data  Processing 

The  data  structures  for  images  and  for  maps  differ 
because  of  their  acquisition  philosophy  and  the  operations 
intended  on  them. 


Images  are  stored  as  matrices  and  contain  at  first  no 
explicit  information  on  a  structural  level,  whereas  spatial 
data  of  maps  have  the  form  of  vectors  associated  with 
location  coordinate  and  can  therefore  be  from  the  beginning 
labelled  with  relational  properties.  Images  are  formed 
"physically"  by  discretizing  a  signal  which  varies  over  a 
two-dimensional  domain,  treating  each  point  uniformly;  map 
data  are  digitized  "logically"  by  entering  meaningful 
entities  such  as  lines  or  boundaries  from  which  the  objects 
can  easily  be  reconstructed. 

To  use  map  data  in  image  processing  and  to  incorporate 
scene  analysis  results  to  update  map  information,  these 
structures  have  to  be  adapted  to  one  another  (Figure  2). 

The  procedure  of  vector-to-raster-conversion  is 
well-known  and  has  been  used  in  previous  investigations. 
Single  objects  can  be  retrieved  from  the  map  data  base  and 
transformed  to  templates  or  masks.  A  more  involved 
procedure  has  to  be  applied  when  a  whole  raster  frame  must 
be  filled  with  labels  for  different  regions  which  together 
cover  the  entire  area.  Most  algorithms  have  difficulties  to 
preserve  geometric  properties  such  as  area  and  adjacency 
under  discrete  metrics,  especially  for  small  objects. 
Figure  3  indicates  the  problem  by  a  simple  example. 

Raster-to-vector-conversion  is,  for  single  objects, 
also  relatively  easy  to  handle.  However,  the  errors 
occuring  during  processing  (discretisation  and  curve 
fitting)  do  not  allow  conversions  to  be  strictly  reversible. 


VECTOR-TO-RASTER-CONVERSION 
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When  transforming  entire  frames  to  the  vector  structure  an 
additional  problem  arises.  As  the  conversion  goes  from  a 
data  structure  with  low-level  implicit  relations  to 
high-level  explicit  relations,  these  have  to  be 
reconstructed.  This  means  that  not  simply  boundaries  are  of 
interest,  but  rather  the  edges  and  nodes  which  separate  the 
different  objects.  This  holds  not  only  for  the  integration 
of  analysis  results  into  a  particular  data  base,  but  also  if 
we  try  to  get  symbolic  descriptions  of  the  image  contents. 


Approaches  To  Scene  Analysis 


Change  detection  in  imagery  car.  be  approached  in 
different  ways  depending  on  the  level  of  data  abstraction. 


The  most  simple  process  involves  only  the  image  domain. 
Two  images  have  first  to  be  registered  with  respect  to  their 
geometries.  Leberl  and  Ranzinger  (1982)  have  shown  that 
modern  instrumentation  for  navigation  can  give  very  accurate 
ancillary  data  with  which  a  preliminary  registration  can  be 
accomplished.  A  fine  overlay  with  sub-pixel  accuracy  is 
possible  by  subsequent  digital  correlation.  Image 
differencing  then  yields  indicators  for  changes.  The 
advantage  of  this  method  Is  mainly  Its  easy  Implementation. 
A  rough  sketch  of  image  contents  is  thus  possible.  However, 
it  does  not  take  into  account  different  light  conditions  and 
does  not  yield  any  clues  as  to  what  has  actually  occured. 
As  a  preprocessing  step,  it  may  prove  nevertheless  valuable. 
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Figure  3:  Difficulties  in  vector-to-raster  conversion, 
Four  congruent  squares  in  vector  representation 
do  not  yield  congruent  squares  in  the  raster 


A  complex  approach  takes  place  on  the  symbolic  level. 
Here,  the  image  is  first  segmented  into  meaningful  parts. 
These  parts  are  then  described  in  a  relational  structure 
which  also  contains  shape  and  grey  value  properties.  These 
parts  are  then  matched  with  the  symbolic  description  of  the 
knowledge-base,  in  this  case  with  the  map  contents.  In  many 
cases  where  no  detailed  spatial  knowledge  is  available,  the 
method  proves  to  be  feasible.  The  segmentation  process  uses 
only  image-inherent  information  and  will  thus  be  rather 
complicated.  But  there  exists  in  our  context  a 
comprehensive  description  of  what  is  to  be  expected  in  the 
image  which  can  be  used  to  guide  segmentation. 

This  leads  to  a  third  approach  which  we  are  taking  In 
this  study:  The  map  data  base  contains  positional  as  well 
as  relational  information  to  make  meaningful  segmentation 
possible.  The  correspondence  between  map  and  image  which 
can  first  coarsely  be  established  by  recognition  procedures 
(developed  in  previous  investigations)  is  stepwise  refined 
by  matching  objects  of  the  map  data  base  to  image  features. 
The  segmentation  processes  can  be  made  considerably  complex 
without  becoming  untolerably  time-consuming,  as  the  areas  in 
the  image  domain  that  qualify  for  inspection  are  small.  The 
topological  relations  represented  in  the  map  data  base  can 
be  exploited  to  make  the  search  for  objects  goal-oriented. 
The  spatial  description  can  be  exploited  to  verify 
recognition  by  comparing  the  results  obtained  to  the  results 
expected.  Non-  verification  may  point  out  areas  which  have 
undergone  ch.anges. 


A  Strategy 


The  strategy  to  be  taken  relies  on  the  tools  provided 

(a)  establish  geometric  correspondence 
between  map  and  image 

(b)  select  object  from  data  base 


(c)  transform  object  to  image  data  structure 

(d)  select  suitable  recognition  procedure 

(e)  recognize  object 

(f)  verify  match 

(g)  if  verification  successful,  mark 
object  as  present  and  continue  with  (b) 

(h)  if  not  verified,  mark  area  as 
unidentified  and  continue  with  (b) 

This  strategy  is  terminated  if  the  data  base  is 
exhausted  or  a  large  number  of  mismatches  indicates  a  severe 
error.  Result  is  a  list  with  matched/unmatched  object  and 
an  image  which  shows  the  segmentation  results.  The 
interpreter  now  may  enter  an  interaction  with  the  system  to 
resolve  identification  problems.  Updates  are  optionally 
entered  to  the  map  data  base. 

Test  Data 

The  aerial  imagery  selected  for  test  purposes  consists 
of  a  multitemporal  series  of  four  overflights  which  cover  a 
period  from  June,  1968  to  May,  1982.  Scales  range  from 
1:9000  to  1:30000,  thus  representing  different  degrees  of 
detail.  The  imaged  area  lies  south  of  Graz  and  was  also 
used  in  previous  studies.  There  is  no  significant  terrain 
relief  so  that  problems  with  geometry  should  be  minimal. 

The  photos  document  urban  growth  with  new 
infrastructure  (motorway),  industrial  settlements  and 
suburban  housing.  The  river  Mur  serves  as  an  invariant 
backbone  as  well  as  some  mayor  roads  in  the  area. 
Agricultural  land  use  and  forest  are  other  dominant 
components.  Thus,  various  tests  can  be  carried  out  on 
features  with  different  characteristics. 
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compute  area  and  centre  of  gravity 
correlate  masks 
print  mask 

disable  processing  of  mask 

fill  interior  of  area  given  by  mask 

.enable  processing  of  mask 

logical  combinations  of  masks 

shift  mask  within  its  window 

load  mask  from  image  file  to  work-file 

load  mask  from  mask  file  to  work-file 

set  image  pixels  to  constant  value  at  locations 

defined  by  mask  (choropleth  generation) 

complement  of  mask 

region  growing 

store  mask  from  work-file  on  image  file 
store  mask  from  work-file  to  mask  file 


Line  Following 

interactive  input  oT  line  transition  points 
line  following  -  forward  search 
line  following  -  backward  search 


Organisation 


AS!,' 

+ 

3DIKF0 

+ 

BKW 

+ 

COM 

+ 

EKD 

EXIT 

+ 

KELP 

+ 

KILLED 

+ 

KILLS IN 

.  + 

KILLHIS 

+ 

K1LLL0K 

+ 

KILLWORK 

+ 

LOG 

WORK 

+ 

assignment  of  input/output  devices 

information  about  existing  images 

definition  of  actual  image  name  and  window  for 

subsequent  processing  steps 

insert  comments  into  work  protocol 

end  of  DIBAG  session 

pause  in  DIBAG  session 

information  about  instruction  set 

delete  image  file 

delete  mask  work-file 

delete  histogram  work-file 

delete  lookup-table  work-file 

delete  all  work  files 

print  work  protocol 

information  about  work-file  contents 


DEAiiZA  TASKS  DESCRIPTION 


on  25-OCT-83  APGVJ” 


SAVPIC 
SHOPIC 
SHOP 5 6 


ADATHR 

ARUTIL 

AUTCOR 

AUTOCR 

AVERAG 

BASRLF 

COKVLV 

DIDXY 

DIFVEC 

DIST 

DVP 

EDGE 

LAPLAC 

MEDIAN 

KIKMAX 

HDTEST 

PCT 

PCT1 

RATIO 

REGAVG 

R03ERT 

SETPCL 

SHOCLA 

SOBEL 

THRESH 

VECLEN 


BINRNK 

BLOSHR 

KASKCL 

KASKOP 

HASKWD 

PCTBIN 

SHOBIT 

SKELET 


CLRKEM 

CPYMEM 

FLICKR 

FLIP 

SPLIT 


Directory  ADEANZA.FZG.EXEO 


Programs 


Image  Transfer  ===  =  =  =  =  =  =  =  =  ====  ===  =  =  =  =  =  =  =  =  =  =  =  =  =  =  =  = 

save  image  memories  to  disc  file 
get  image  from  disc  file 

display  four  different  images  in  256**2  v.'indov’s 

Image  Processing  ================================= 

adaptive  thresholding 

perform  arithmetic  operations  on  channels 
autocorrelation  function  via  DEAKZA 

autocorrelation  under  a  256x255  (max)  cursor  rectangle 

mean  of  four  images 

biased  simple  edge  operator 

convolution  with  cos-exp  or  own  mask 

simple  edge  operator 

difference  vector  image  from  max. 5  images 

mask  distance  transform 

DVP  program  interpreter 

various  edge  enhancement  techniques 

Laplace  edge  operator 

median  approximation  under  3x3  mask 

minimum  and  maximum  under  nxn  mask 

normal  distribution  test;  CKI  square 

principal  component  transformation  -  compute 

principal  component  transformation  -  transform 

ratio  image 

regional  averige  for  texture  parameter  acquisition 
Roberts  edge  operator 

assignment  of  selected  colours  to  arbitrary  pixelvalues 

show  pixels  with  cursor  defined  values  in  two  images 

Sobel  edge  operator 

interactive  threshold  determination 

create  vector  length  image 

Binary  Image  Processing  ========================== 

Tank  operator  on  binary  image 
blow/shrink  rank  operator 
clean  binary  mask 

set/clear  pixels  in  binary  mask  according  to  neighbors 
calculate  DIBAG  window  of  binary  mask 
PC-trafo  for  masks 

show  binary  image  transformation  table 
skeletonisation  .. 

s  Memory  Manipulation  ============================= 

clear  memory 
copy  memories 

exchange  two  image  channels 
mirror  or  rotate  image  channel 
copy  half  image 


EMHAii 

Ei.’HAKC 

EQUAL 

HILITE 

IHSRGB 

IHSRG3HR 

IP5KCC 

IP5UIII 

JP5ITT 

i-lAtvITT 

PLCTIT 

PSEUDO 

REDRES 

SETITT 

SFG 

SPLICU 
WIL'D  16 


HISTO 

HIST2 

LINHIS 

PIXVAL 

ROBUST 

SUSHIS 

THRLIM 


IKTPZM 

JSCRZM 

JSCZK1 

JSELZi-J 

LDSCR 

SMALL 


PLTKAP 

REGDEF 

SETITT 

SETOV 

TICKS 


EDITAN 

IP5A1JW 

SHOKAN 

SHOWPG 

SAVEAN 


Image  Enhancement  =========================== 

ina^e  enhancement  via  LUT ;  lin.rar.p  from  C. 1-99.9" 
image  enhancement  via  LUT;  lin.rar.p  from  1-99" 
automatic  linear  rarp  generation 
blinking  threshold  region 
intensity-saturation-hue  to  RGB 

intensity-saturation-hue  to  RGB;  high  resolution 

contour  lines 

histogram  equalisation 

manipulate  lookup-tables  with  joystick 

special  functions  for  rendition  on  screen 

plot  ITTs  in  G/0 

interactive  pseudo  coloring  module 
change  inage  resolution 
manipulate  ITTs  or  LUTs 
set  SFG  parameters 

manipulate  splitscreen  coordinates  with  joystick 
manipulate  ITTs  for  16  bit  image  data 

Histograms  and  Statistics  ====================== 

calculate  print  and  plot  a  histogram 

two  dimensional  histogram 

generate  line  histograms 

interactive  pixel  value  determination 

robust  statistic  estimates  from  image 

separate  histograms  for  each  Landsat  sensor 

calculate  limit  under  which  p  percent  of  pixels  lie 

Zoom  and  Scroll  ============================== 

zoom  with  softwa re  interpolation 
scroll  and  zoom  image 
scroll  and  zoom  image  102^^102^ 
zoom  image 

scroll  three  images  simultaneously  in  SFG  windows 
reduce  512x512  image  to  256x256  in  upper  left  quarter 

Graphic  Overlay  =============================== 

superpose  map  (vector)  data 

define  region  with  joystick  and  vector  fill 

manipulate  ITT  for  graphic  overlay 

set  pixels  in  G/0  with  joystick 

plot  tick  grid  or  various  marks 

Image  Annotation  =============================== 

edit  annotation  overlay 
write  annotation 
get  annotation  from  disc  file 
load  the  A/0  from  a  text  file 
save  annotation  to  disc  file 


Miscellaneous 


AKZDEZ  print  image  window  values  defined  by  cursors 

B'.s’LOOP  loop  through  blsck/white  rendition  of  channels 

GEKPIC  generate  .PIC  file  with  0-values 

IMLOOP  show  animated  'fill' 

SELCP  select  control  points 

SKALA  show  scale  narks  on  reference  scales 

WRSCAL  write  reference  scale  to  inage  file  or  channel 

================  Classification  =========================: 

AHACLA 

ANAHIS 

bila.nz 

BILGRA 
CLADIS 
CLUSTA 

CKPCLA 
JMDIST 
MAXCLA 

MAXLIK 
KINDIS 
PARE PI 
PIXLST 
PIXSTA 
PLTFEA 
PLTKAP 
PXVLST 
RECLAS 
SCATTER 
SHOCLU 
TESTMD 
TESTML 
TESTPE 


Versatec  Interface  ============================= 

output  of  binary  mask  of.G/O  to  VERSATEC  or  .BIN  file 

output  of  image  with  gray  scale  software  to  VERSATEC 

output  of  inage  with  gray  scale  software  to  .BIN  file 

genererate  plotfile  for  PRISM  dot  matrix  printer 

/  ’  > 

Test  and  Demonstration  ========================= 

test  image 

color  tatfie  for  color  selection 
demonstrate  rextangle  generation 
demonstrate  cursors 
demonstrate  vector  plotting 

create  test  image  (ascending  ramps  in  two  channels) 

route  memories  via  SPG  to  video  . 

checkerboard  pattern  in  channel 

SFG-splitscreen  capability  demonstration 

mirror  all  channels  on  vertical  centerline 

scroll  image  channels  in  spirals 

generate  linear  ramps  in  memories 

test  image 

generate  a  test  pattern 


CNVRGE 

COLTAB 

DEM30X 

DEKCUR 

POLYDG  - 

QUADER 

SELCOL 

SHOVLY 

SHSPLT 

SPINCX 

SP1RSC 

SPLTM1 

TESTIK 

TESTPAT 


AKZBIH 
AN  Z  COL 
ANZCOLF 
BIKOUTPRI 


analyze  classification  statistics;  print  value  ranges 
of  gray  values  for  each  image 

analyze  histogram  to  show  multiple  classifications 

count  classified  pixels  in  selected  raster 
result  of  EILANZ  as  image 

compute  class. distances  per  image  on  .STA  file 
cov. matrix, inverse  and  determinant;  corr-rmatrix; 
eigenvectors  of  the  cov-mat. for  a  set  of  train-pixels 
comparison  of  classification  results 
distances  of  clusters 

reclassify  image  according  to  most  frequent  class 
in  the  neighbourhood  of  each  pixel 
maximum  likelihood  classification 
minimum  distance  classification 
parallel  epiped  classification 

list  of  pixel  coordinates  which  are  narked  in  C/0 
compile  statistics  for  training  areas 
plot  of  feature  vectors 
draw  situation  over  img 

get  feature  values  for  pixels  in  training  areas 
reclassify  multiply  classified  pixels 
scatter  plot  of  training  pixels 
interactive  classification 

a  priori  test  minimum  distance  classification 
a  priori  test  max. likelihood  classification 
a  priori  test  parallel  epiped  classification 


DVFTST 

DVPP.EG 


CP.EIP5 
DELIP5 
DEA DM? 
STATUS 
SWITCH 
SYSIKT 


Development  Tools  :::::::::::::: 

define  an  instruction  for  the  DVP 
run  the  DVP  with  octal  register  input 

K.anagenent  =  =  =  ===  =====  =  =  =  =  =  ===  = 

connect  VAX  to  DEAKZA 
disconnect  VAX  froa  DEAKZA 
dump  of  DeAnza  registers  octal 
show  status  of  deAnza  environment 
switchboard  utility 
system  initialisation 


CODES  FOR  FUNCTIONS  IMPLEMENTED  I!.' 
THE  DVP  OPERATIONS  PROGRAjM  DVP 


DVPCLR 

1 

DVPCPY 

2 

DVPSET 

3 

DVPCPL 

4 

DVPSHF 

5 

DVPSH3 

6 

DVPXCH 

7 

DVPADD 

11 

’DVPSU3 

12 

DVPMUL 

13 

DVPDIV 

14 

DVPMAX 

15 

DVPHIH 

16 

DVPCNT 

17 

■  DVPSUK 

18 

DVPA16 

19 

DVPSQR 

20 

DVPADC 

21 

DVPSBC 

22 

DVPMLC 

23 

DVPDVC 

2h 

DVPINC 

25 

DVPDEC 

26 

DVPAVG 

27 

DVPLIN 

26 

DVPADL 

29 

DVPTHR 

30 

STORCH 

31 

LOADCH 

32 

SETRWC 

33 

SCROLL 

34 

PIXCKK 

35 

SETCUR 

36 

NBKAP 

37 

N3CNT 

38 

ZOOM 

39 

SCRLZM 

40 

DVPMAR 

41 

DVPCLB 

42 

DVPMCY 

43 

DVPKCP 

44 

DVPMND 

45 

DVPMOR 

46 

DVPMEO 

47 

DVPKEQ 

48 

DVPCMP 

49 

DVPCME 

50 

DVPA3S 

51 

DVPLOG 

52 

DVPEXP 

53 

DVPBOO 

54 

TO  SOFTWARE  SWITCHBOARD  ...  99 


INPUTS  REQUIRED 

GENERAL  PROCEDURE:  FIRST  PROMPT  IS  FOR  OP-CODE 

SECOND  PROMPT  IS  FOR'  PARAMETERS 
Z  IS  END 

RV.'C  MEANS  REGIONAL  WRITE  CONTROL  CODE 
0  -  UNCONDITIONAL 

1  -  REGION. DEFINED  EY  CURSORS 

2  -  REGION  DEFINED  EY  CURSORS  AND 

RWC  BIT  OF  ITT4 

3  -  REGION  DEFINED  BY  CURSORS  AND 

COMPLEMENT  OF  RWC  BIT  OF  ITT4 


OP-CODE 


DVFCLK  (  1) 
DVPCPY  (  2) 
DVPSET  (  5) 
DVPCPL  (  H) 
DVPSHF  (  5) 
DVPSK3  {  6) 
DVPXCH  (  7) 
DVPADD  (11) 
DVPSU3  (12) 
DVPM'JL  (13) 
DVPDIV  (111) 
DVPKAX  (15) 
DVPKIH  (16) 
DVPCKT  (17) 
DVPSUM  (18) 
DVPA16  (19) 
DVPSQR  (20) 
DVPADC  (21) 
DVPSBC  (22) 
DVPMLC  (23) 
DVPDVC  (211) 

DVPINC  (25) 
DVPDEC  (26) 
DVPAVG  (27) 
DVPLIN  (28) 
DVPADL  (29) 
DVPTHR  (50) 
STORCH  (3D 
LOADCH  (32) 
SETRVJC  (53) 
SCROLL  (3*0 
PIXCHK  (35) 
SETCUR  (56) 
KBMAP  (37) 
i-JBCKT  (38) 
ZOOM  (39) 
SCRLZM  (HO) 
DVPMAR  (HI) 
DVPCLB  (H2) 
DVPHCY  (H3) 
DVPHCP  (HH) 
DVPKKD  (H5) 
DVPKOR  (H6) 
DVPMEO  (H7) 
DVPMEQ  (H8) 
DVPCKP  (H9) 
DVPCME  (50) 
DVPABS  (51) 
DVPLOG  (52) 
DVPEX?  (53) 
DVPBOO  (5H) 


clear  image  memory 

copy  inage  memory 

set  memory  to  value 

copy  inage  memory  via  lookup-table 

shift  16  bit 

shift  8  bit 

exchange  two  images  in  nenory 
addition  8+8  bit 
subtraction  8-6  bit 

multiply  8  tines  8  bit  giving  16  bit  result 

divide  8  into  8  bit  giving  8  bit  remainder 

max imam  of  two  channels 

mininun  of  two  channels 

get  count  register  contents 

sum  over  all  pixels 

addition  16+8  bit 

square  root  of  16  bit 

addition  of  6  bit  constant 

subtraction  of  8  bit  constant 

multiply  by  6  bit  constant 

divide  by  8  bit  constant 

increment  image  memory 

decrement  image  memory 

mean  of  tv?o  images 

scaled  linear  combination  of  images 

addition  8  bit  nodif  by  ITT  +  8  bit 

threshold  on  image 

save  memory  to  disc  file 

load  memory  from  disc  file 

set  regional  write  control  bits  in  ITTH 

set  scroll  for  DVP  in  DI3AG  coordinates 

check  pixel  values  in  memories 

allows  manipulation  of  cursors  to  fix  window 

map  neighbourhood  in  binary  mask  to  8  bit  number 

count  pixel  neighbourhood 

tfLOOin 

scroll  and  zoom  of  specified  channels 

area  of  mask 

clear  bit  plane 

copy  mask  (bit  plane) 

complement  mask 

.and.  masks 

.or.-  masks 

exclusive  .or.  masks 

.equivalence,  masks 

set  flag  mask  after  comparing  two  images  = 
set  flag  mask  after  comparing  two  images  = 
absolute  value  of  7  bit  signed  number 
log  function  on  image 
exp  function  on  image 
boolean  operations  on  images 


